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2 (54) Title: COLOUR COSMETIC SELECTION SYSTEM 



^ ( 57 ) Abstract: A virtual makeover method is provided allowing a customer to select an optimum colour cosmetic palette through 
interaction with an Internet web site. The method includes downloading from the Internet web site a facial image which may be 
that of customers themselves, selection of a particular type of colour cosmetic, selection of a first colour from a palette of colours, 
application of the first colour to areas of the facial image and once the customer is satisfied with the colour selection, placement of 

^ an order for that cosmetic product appropriate to the area in the selected colour. 
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COLOUR COSMETIC SELECTION SYSTEM 
Field of the Invention 

5 The present invention relates to a system for allowing a 
customer to select a colour palette of facial cosmetics and 
viewing their visual effect prior to actual application to 
the customer's face, 

10 BACKGROUND OF THE INVENTION 6 PRIOR ART 

Stay at home shopping has become quite popular. Indeed the 
twenty-first century will likely move a majority of 
purchasing from the store to the home. Virtual shopping on 
15 the Internet is already a lively phenomenon. 

Some products are quite difficult to select without personal 
interaction with the actual product. Colour cosmetics are 
an excellent example. Consumers are faced with a palette of 

20 colour which requires personalization and selection. 
Lipstick must match with foundation. Eye shadow and lip and 
eyeliners must be in harmony with other colours painting the 
face. Until now, the only way a consumer could determine 
their preferred combination was through applying the actual 

25 cosmetic onto the face through trial and error. 

Cosmetic customers have been aided by a number of companies 
in the industry that have sought to provide a means for 
selecting the customer's optimal colour shade. For example , 
30 Clinique and Clarion have installed computers at sales 
counters for use by the customer. Information on colour 
shade, oiliness and other properties of a customer's skin 
are punched into the computer which then determines the 
company's most closely matching product. 

35 
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Custom blending is also offered by two major companies, 
Prescriptives (a division of Estee Lauder) and Visage (a 
division of Revlon) . They begin a sale by manually 
evaluating a subject's skin colour. The salesperson is 
5 trained through the use of match cards to identify a user's 
matching skin foundation. Unfortunately manual systems 
suffer from poor reproducibility. Extensive training must 
also be invested in the salesperson. 

10 U.S. Patent 5,622,692 (Rigg et al.) reports a system for 
customising a facial foundation product at point of sale to 
a customer. Three essential elements are present. They 
include a skin analyser for reading skin properties, a 
programmable device receiving the reading and correlating it 

15 with an optimal formula and a formulation machine for 
preparing the facial foundation product from various 
cosmetic chemical compositions. Technology described in 
this patent has commercially been embodied in Elizabeth 
Arden' s Custom Colour system available for many years in 

20 major department stores. Arden' s system has been a 
significant advance in the art. 

However, it suffers from certain deficiencies including the 
inability of customers to evaluate different colour 

25 cosmetics in the context of their own skin coloration and in 
juxtaposition to combinations of different facial makeover 
products. Thus, it would be desirable to have visualised a 
lipstick and a foundation, eye shadow and/or blush on a 
colour interactive basis. Especially desirable would be to 

30 evaluate the interaction of the various colour cosmetics 
without actually having to place these on one's own face. 

Another problem of the practiced art has been the inability 
of a customer to render an informed buying decision far from 
35 the store. It is true that the Internet has allowed home 
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purchasing of products with which the customer is well 
acquainted. However, where a product requires a more 

physical review, such as visualising colour cosmetics, these 

have not yet rendered themselves suitable for Internet 
purchase . 



Accordingly, it is an advantage of the present invention to 
provide a system and apparatus for virtual makeover of a 
facial colour palette without the necessity of the customer 
10 actually having to try on each colour cosmetic prior to 
final selection. 



Another advantage of the present invention is to provide a 
virtual facial colour makeover that can be done in the 
15 privacy of the home. 

These and other advantages of the present invention will 
become more readily apparent from the following summary and 
detailed discussion. 



20 



SUMMARY OF THE INVENTION 



According to a first aspect, the present invention provides 
a virtual makeover method for furnishing a customer with 
25 colour cosmetics including: 

(i) downloading from an Internet web site a facial 
image ; 

(ii) selecting a colour cosmetic from eye shadow, 
lipstick, foundation, eyeliner, mascara, lip 

30 liner, blush and combinations thereof; 

(iii) selecting a first colour from a palette of 
colours for applying to a specified area of the 
facial image; and 

(iv) placing an order for the selected cosmetic with 
35 corresponding selected colour. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The various objects , features and advantages of the present 
5 invention will become more readily apparent from 
consideration of the following drawing in which: 

Fig. 1 is a flow chart diagramming a program used in 
the system of the invention for selecting facial colour 
10 cosmetic schemes; 

Fig. 2 shows Screen 2 of the program; 

Fig. 3 shows Pop-Up Screen 3 of the program; 

15 

Fig. 4 shows Pop-Up Screen 4 of the program; 

Fig. 5 shows Overlay 5 of the program; 

20 Fig. 6 shows Screen 6 of the program; 

Fig. 7 shows Overlay 7 of the program; 

Fig. 8 shows Pop-Up Screen 8 of the program; 

25 

Fig. 9 shows Pop-Up Screen 9 of the program; 

Fig. 10 shows Pop-Up Screen 10 of the program; 

30 Fig. 11 shows Pop-Up Screen 11 of the program; 

Fig. 12 shows Pop-Up Screen 12 of the program; 

Fig. 13 shows Pop-Up Screen 13 of the program; 

35 
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Fig. 14 shows Pop-Up Screen 14 of the program; 

Fig. 15 shows Overlay Screen 15 of the program; 

5 Fig. 16 shows Pop-Up Screen 16 through 19 of the 

program; 

Fig. 17 shows Pop-Up Screen 20 of the program; 

10 Fig. 18 shows Pop-Up Screen 21 of the program; 

Fig. 19 shows Pop-Up Screen 22 of the program; 

Fig. 20 shows Pop-Up Screen 23 of the program; 

15 

Fig. 21 shows Screen 24 of the program; and 

Fig. 22 shows Overlay 25 of the program, 

20 DETAILED DESCRIPTION OF THE INVENTION 

Now it has been found that virtual makeover can' be 
accomplished on-line through an Internet web site. A 
visualising facial image is projected onto a monitor. The 

25 customer is then given the ability to paint various areas of 
the face representing locations normally to be covered by 
eye shadow, lipstick, foundation, eyeliner, mascara and the 
like. These different areas of the face can be painted with 
a variety of different colours from the cosmetic product 

30 palette until an optimum combination is reached satisfactory 
to a look which the customer desires. A final step of the 
method involves placement of an order with a vendor for 
cosmetic products with the chosen colour. No longer does a 
customer actually need to try the product on his or her own 
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face. A very rapid and clean evaluation can occur through 
use of the visualised model face. 

As an optional feature, the customer may input a measurement 
of their actual facial skin colour. Such measurement can 
occur through use of a home video camera that transmits 
digitalized information to the web site. Measured true skin 
colour values may also be obtained by the customer visiting 
a point-of-sale location (e.g. store) where such 
measurements can be taken by a vendor representative and fed 
into the web site database for future use at the customer's 
home location. 

Advantageously the facial image appearing on the web site is 
initially coloured with a shade representing the customer's 
actual measured shade. Colours for lips and eye areas can 
then be manipulated through the computer program and 
visualised on the facial image for selection of the most 
desired combination. Particularly preferred is display of a 
facial image corresponding exactly to that of the customer 
based on the earlier digitalized photographic input of the 
customer's face. 

Fig. 1 is a flow chart of a program according to one 
25 embodiment of this invention. After the opening screen, a 
user is introduced to Screen 2 known as the 'customer 
session' . Client information is obtained via this screen 
through either a swipe card, entry via a keyboard or from a 
database. The screen remains active (buttons are available) 
30 when overlays are displayed. Fig. 1 provides a view of 
Screen 2. 

A Pop-up Screen 3 next appears with comments and client 
information to prompt follow-up calls. This screen can be 
35 used for contacting the client to remind them to visit the 
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15 



20 
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store when their cosmetic supply may be low. Fig. 3 
illustrates the screen. 

Pop-up Screen 4 covering 'Maintenance' is then available for 
5 appearance. This pop-up screen has options for calibration . 
and data handling. Fig. 4 sets forth the screen. 

Other information is collected with Overlay Screen 5. The 
Overlay screen selects/changes information about skin, 
10 beauty habits, type and brand of products used. Overlay 
Screens 2 and the buttons on Screen 2 remain active. Fig. 5 
describes Overlay Screen 5. 

Screen 6 provides a 'Consultant's Choice'. This screen 
15 shows effects of colour palette, using client's skin colour. 
Information on the client's skin colour is obtained through 
application of a hand-held spectrophotometer against areas 
of the face not likely to be covered by makeup. These areas 
include the neck and under chin areas. The cosmetic 'look' 
20 can either be based on skin colour (skin recommendation) , 
lipstick colour (colour family), or a specific look. 
Depending on selections, a list of typically five 'looks' is 
created, and selecting (another look) displays next look in 
the series. Fig. 6 sets forth Screen 6. 

25 

Purchase information is achieved in Overlay Screen 7. This 
screen with previous and current purchase information 
(overlay to screen 2) is ordered by visit date. It contains 
information from up to the last five visits. Purchase 
30 information includes number, product type, product name and 
product number. Fig. 7 sets forth the purchase information 
screen. 

Pop-up Screen 8 measures skin colour. It consists of a 
35 series of screens to assist an adviser with colour 
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measurement. This session is repeated three times. Fig. 8 
depicts the Pop-up Screen 8. 

Pop-up Screen 9 serves to obtain information for a new 
5 store. It is used by the installation team to correctly set 
up the store-specific parameters. Fig. 9 describes the Pop- 
up Screen 9. 

Collection of data for the main office is found in Pop-up 
10 Screen 10. Data is placed in a store's outbox, and can then 
be transferred in three ways. These include: (1) remote 
computer can dial in and retrieve file from outbox; (2) 
transfer information to a server automatically using PC- 
anywhere script; and/or (3) copied to floppy disk and mailed 
15 to central site. Fig. 10 illustrates the Pop-up Screen 10. 

Pop-up Screen 11 copies data from other stores. It can 
accept data in two ways. These include: (1) update using 
floppy supply by the main office; or (2) use of PC/Anywhere 
20 script to retrieve update file from main office outbox. 
Fig. 11 illustrates the Pop-up Screen 11. 

Pop-up Screen 12 allows selection of a colour lipstick 
family. The customer advisor can either enter a specific 

25 lipstick number, or choose a colour family, then choose a 
colour from the family. The active colour palette will 
consist of individual palettes that contain that lipstick. 
The advisor can also enter a specific look (which can be 
either from a previous visit, or any of the available looks 

30 in the palette). Fig. 12 describes the pop-up Screen 12. 

Pop-up Screen 13 allows selection of lipstick from a colour 
family (as selected from Pop-up Screen 12) . If the lipstick 
is also in the palette recommendation based on skin tone, 
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the colour is put first in the list, and (expert fit) is 
added to the name. Fig. 13 describes the Pop-up Screen 13. 

Pop-up 14 shows product selections (e.g. treatments in 
5 cosmetic colours) made during the present session. Product 
selections can be made during colour viewing (Screen 6), 
treatment /product options (Overlay 24) or Recommended 
Foundation (Pop-up Screen 20) . There also is a display of 
recommended looks. Fig. 14 describes the Pop-up Screen 14. 

10 

Overlay Screen 15 is used to provide a snapshot of the type 
of customer. For detail purchase history, Overlay 7 
provides the purchase information. Included in this screen 
are key purchase properties, group by type, over the past 
15 twelve months. It is automatically displayed for each 
customer. Fig. 15 lists the Overlay Screen 15. 

Pop-up Screen 16 is a probe for calibration/routine and for 
messages to calibrate probe. Fig. 16 details the Pop-up 
20 Screens 16-19. 

Pop-up Screen 20 is used to recommend the best foundation 
product combination based on skin colour and product 
preferences. Fig. 17 details the Pop-up Screen 20. 

25 

Pop-up Screen 21 is an advanced data management module. 
This is used by the main office. Fig. 18 details the Pop-up 
Screen 21. 

30 Pop-up Screen 22 relates to language selection. Fig. 19 
details Pop-up Screen 22. 

Pop-up Screen 23 is used to locate and activate a client. 
If this is a new client, the 'new' button is clicked to 
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create the new client file. Fig. 20 details Pop-up Screen 
23. 

Screen 24 details treatment/colour/fragrance options showing 
5 all the option products. Fig. 21 details Screen 24. 

Overlay 25 focuses on skin colour analysis allowing 
selection of shade and tone. Fig. 22 details the Overlay 
25. 

0 

The foregoing description illustrates selected embodiments 
of the present invention. In light thereof variations and 
modifications will be suggested to one skilled in the art, 
all of which are within the scope of this invention. 
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CLAIMS : 

1. A virtual makeover method for furnishing a customer with 
colour cosmetics, the method comprising: 

(i) downloading from an Internet web site a facial 
image ; 

(ii) selecting a colour cosmetic from eye shadow, ' 
lipstick, foundation, eyeliner, mascara, lip liner, 
blush and combinations thereof; 

(iii) selecting a first colour from a palette of 
colours for applying to a specified area of the 
facial image; and 

(iv) placing an order for the selected cosmetic with 
corresponding selected colour. 

2. The method according to claim 1 wherein the facial image 
is painted with the customer's own natural skin colour. 

3. The method according to claim 2 wherein the customer's 
20 own natural skin colour has been stored as digitalized 

information accessible to the web site, the digitalized 
information having been obtained through measurement of a 
customer's actual skin. 

25 4. The method according to claim 3 wherein measurement of a 
customer's actual skin occurs at the customer's home through 
use of a camera with capability of digitalizing information 
taken from measurement of the customer's skin and a 
mechanism for transmitting the digitalized information to a 

30 central memory controlling the web site. 
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FIG. 6 
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FIG. 9 
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FIG. 10 
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FIG. 12 
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FIG. 15 
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FIG. 13 



Language Selection 
[English] 
(Spanish] 
(French] 



FIG. 20 



Search for Customer 



Name: 




List of Names 






Information 




On 




Selected 




Customer 



ACCEPT 1 

NEW CUSTOMER] 

CANCEL I 



FIG. 21 



Treatment/Color Product Options 

Color I [ ITreatment 

iColor 

ex IFragrance 

[Recommend] 

1 I Purchase] 

[Sample] 
(Not appropriate] 



[What's New] 



ACCEPT 
CANCEL 



Product 

Skin Illuminating Comph 
Millenium Night 
Millenium Energist 



Advertiserae 
Video 



WO 01/04840 



PCT/EPOO/05459 



13/13 



CO 



at o 

o x to 
o o o 

occou 



IS 






INTERNATIONAL SEARCH REPORT 



ml Application No 

PCT/EP 00/05459 



B. FIELDS SEARCHED 


Minimum documentation searched (ctasstficatior 


system tolowed by deification symbols) 


IPC 7 G06T A45D 


Documentation searched other than minimum do 


cumentaton to the extent that such documents are tnctuded in the fields searched 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 G06T 11/00 A45D44/00 



According lo International Patent Classification (IPC) of lo both national aassificaiion and IPC 



Electronic data base consulted during the international search (name of data base ana where practical, search terms used) 

WPI Data, EPO-Internal , IBM-TDB, INSPEC 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ' Citation o! document, with in deal ion. where appropriate, of the relevant 



Relevant lo claim No. 



EP 1 030 267 A (DRDC LIMITED ET AL.) 
23 August 2000 (2000-08-23) 
the whole document 

4 WO 98 39735 A (SCALAR CORP ET AL.) 
11 September 1998 (1998-09-11) 
the whole document 

WO 99 23609 A (V.O.F. HEADSCANNING) 

14 Hay 1999 (1999-05-14) 

page 5, line 12 - line 23 

page 7, line 22 -page 9, line 17 

US 5 478 238 A (60URT0U ET AL.) 
26 December 1995 (1995-12-26) 
the whole document 

-/-- 



1-4 
1-4 

1-4 
1-4 



m 



Further documents are listed in the continuation ot box C. 



* Special categories of cited documents : 

'A* decumeni defining the general slate of the art which is not 
considered to be ot particular relevance 

"E* earlier document but published on or after the international 
filing date 

"L* document which may throw doubts on priority claim (s) or 
which is cited to establish the publication date ot another 
citation or other special reason (as specified) 

'O* document referring to an oral disclosure, use. ex hit* ion or 
other means 

a P* document published prtor to the International filing date but 
later irtan the priority date claimed 



*T* later document published after the International fttng date 
or priority date and not in conflict wtth the application but 
cited to understand the principle or theory underlying the 
invention 

'X* document of particular relevance; Ihe claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document Is taken atone 

*Y* document of particular relevance; the claimed Invention 
cannot be considered to involve an Inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art 

'A' document member of the same patent family 



Dale of the actual completion ot the international 

23 November 2000 



Date of mailing ot the international search report 

01/12/2000 



Name and mailing address of the ISA 

European Patent Office. P B. 5618 Patentlaan 2 
IML - 2260 HV Rijswifk 
Tel (+31-70) 340-2040, Tx. 31 651 epo nl ; 
Fax: (+31-70) 340-3016 



Authorized officer 



Abram, R 



Form PCT71SA/210 (wcond sheet) (July 1982) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 




Poem PCT/ISA/2io<c<rwinu« w ra ( 



»«cond«he<x)(Juty ,992 , 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

Information on patent family member* 



intom «rfial AppUcatton No 

PCT/EP 00/05459 



Patent document 




Publication 


Patent family 


Publication 


cited in search report 




date 


member(s) 


das 


EP 1030267 


A 


23-08-2000 


JP 


10255066 A 


25-09-1998 








WO 


9839735 A 


11-09-1998 


U0 9923609 


A 


14-05-1999 


NL 


1007397 C 


12-05-1999 








AU 


1177499 A 


24-05-1999 








BR 


9813176 A 


22-08-2000 








EP 

LI 


1021797 A 


26-07-2000 


US 5478238 


A 


26-12-1995 


EP 


0638261 A 


15-02-1995 








CA 


2146134 A 


09-02-1995 








DE 


69301239 D 


15-02-1996 








0E 


69301239 T 


14-08-1996 








ES 


2085741 T 


01-06-1996 








WO 


9503727 A 


09-02-1995 








JP 


2986214 B 


06-12-1999 








JP 


8505078 T 


04-06-1996 








US 




25-08-1998 


US 5495338 


A 


27-02-1996 


FR 


2690822 A 


12-11-1993 








CA 


2134985 A 


11-11-1993 








DE 


69301 129 D 

v?JUl 14-7 U 


08-02-1996 








EP 


0569291 A 


10-11-1993 








EP 


0646339 A 


05-04-1995 








WO 


9321794 A 


11-11-1993 








JP 


7506504 T 


20-07-1995 








DE 


69301129 T 


04-07-1996 








ES 


2085734 T 


01-06-1996 


0E 3419568 


A 


28-11-1985 


NONE 






US 4539585 


A 


03-09-1985 


NONE 






EP 226959 


A 


01-07-1987 


JP 


62144280 A 


27-06-1987 








CA 


1261967 A 


26-09-1989 



Form PCTASA/210 (patorH family ann«) (July 1982) 



